9/18/2018 


Comparison to ML Estimation 


9.1.3 Comparison to ML Estimation 

We discussed maximum likelihood estimation in the previous chapter. Assuming that we have 
observed Y — y, the maximum likelihood (ML) estimate of X is the value of X that 
maximizes 


fY\x{y\ x ) (9-1) 

We show the ML estimate of X by Xml ■ O n the other hand, the MAP estimate of X is the 
value of X that maximizes 


fY\x(y\ x )fx(x) (9.2) 

The two expressions in Equations 9J_ and 9_2 are somewhat similar. The difference is that 
Eq uation 9.2 has an extra term, fx (x) . For example, if X is uniformly distributed over a 
finite interval, then the ML and the MAP estimate will be the same. 


Example 9.5 

Suppose that the signal X ~ iV(0, cr‘x) is transmitted over a communication channel. 
Assume that the received signal is given by 

Y = X + W, 

where W ~ iV(0, (T^y) is independent of X. 

1. Find the ML estimate of X, given Y — y is observed. 

2. Find the MAP estimate of X, given Y — y is observed. 

• Solution 

o Here, we have 

1 - — 

x) = _ _ —e 2a x . 

y/2lT(Tx 

We also have, Y\X — X ~ N{x,<J^y),so 

1 (y-x) 2 

fv\x(y\x) = —7= -e 2 °w . 

v L'K 
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1. The ML estimate of X, given Y = y, is the value of X that maximizes 

To maximize the above function, we should minimize (y — tc) 2 . 
Therefore, we conclude 


xml ----- y- 

2. The MAP estimate of X , given Y = y, is the value of X that maximizes 


fY\x(y\ x )fx(x) = cexp. 


jy-x) 2 

2(J W 



where C is a constant. To maximize the above function, we should 
minimize 


( y-xf + X 2 

2a W 2cr X 

By differentiation, we obtain the MAP estimate of X as 

a X 

x M ap — — -— y • 

<*x + a w 
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